Audiovisual prosody and feeling of knowing
نویسندگان
چکیده
This paper describes two experiments on the role of audiovisual prosody for signalling and detecting meta-cognitive information in question answering. The Wrst study consists of an experiment, in which participants are asked factual questions in a conversational setting, while they are being Wlmed. Statistical analyses bring to light that the speakers’ Feeling of Knowing (FOK) is cued by a number of visual and verbal properties. It appears that answers tend to have a higher number of marked auditory and visual cues, including divergences from the neutral facial expression, when the FOK score is low, while the reverse is true for non-answers. The second study is a perception experiment, in which a selection of the utterances from the Wrst study is presented to participants in one of three conditions: vision only, sound only, or vision + sound. Results reveal that human observers can reliably distinguish high FOK responses from low FOK responses in all three conditions, but that answers are easier than non-answers, and that a bimodal presentation of the stimuli is easier than the unimodal counterparts. 2005 Elsevier Inc. All rights reserved.
منابع مشابه
Pragmatic Focus Interpretation: Interplay between Context and Audiovisual Prosody?
We present an experimental study on the effect of context and of audiovisual prosody on pragmatic focus interpretation. The audiovisual material was elicited from our previous production study on the exhaustivity of answers. Here we recorded nine German speakers who were instructed to read dialogues with embedded question-answer pairs in which the answer constituted the pragmatic focus of the u...
متن کاملAudiovisual representation of prosody in expressive speech communication
Prosody in a single speaking style – often read speech – has been studied extensively in acoustic speech. During the past few years we have expanded our interest in two directions: 1.) Prosody in expressive speech communication and 2.) Prosody as an audiovisual expression. Understanding the interactions between visual expressions (primarily in the face) and the acoustics of the corresponding sp...
متن کاملMeasuring and modeling audiovisual prosody for animated agents
Understanding the interactions between visual expressions, dialogue functions and the acoustics of the corresponding speech presents a substantial challenge. The context of much of our work in this area is to create an animated talking agent capable of displaying realistic communicative behavior and suitable for use in conversational spoken language systems, e.g. a virtual language teacher. In ...
متن کاملFeeling of Knowing in Episodic Memory
Feeling of knowing judgments can be viewed as one mode of expressing knowledge of stored information. The present experiments explored the relation of the feeling of knowing to two other modes of expressing knowledge, recall and recognition, by examining how manipulations of encoding, storage, and retrieval conditions affected the relative frequency of positive and negative feeling of knowing j...
متن کامل